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An automaton with advice is a finite state automaton which has access to an additional fixed infinite 
string called an advice tape. We refine the Myhill-Nerode theorem to characterize the languages 
of finite strings that are accepted by automata with advice. We do the same for tree automata with 
advice. 

1 Introduction 

Consider an extension of the classical model of finite automata operating on finite strings in which the 
machine simultaneously reads a fixed advice tape — an infinite string A. A deterministic finite-string 
automaton with advice A is like a deterministic finite-string automaton, except that at step n the next 
state depends on the current state, the n th symbol of the input w S £*, and the n th symbol of A € r m . The 
automaton halts once all of w has been read and accepts w if and only if it is in a final state (in the non- 
terminating model of Section 01 the automaton reads the rest of the advice tape and accepts according to 
a Muller condition). 

We now give a formal definition. 

Definition 1. An automaton with advice is a tuple M = (Q,T.,T,A, d,qo,F). 

1. Q is the finite set of states of the automaton. 

2. £ is a finite set of symbols called the input alphabet. 

3. r is a finite set of symbols called the advice alphabet. 

4. A € r m is the advice string. 

5. 8 : Q X r X L — > Q is the transition function. 

6. qo G Q is the initial state. 

7. F C Q is the acceptance condition. 

The run of M on a string w£E* is a sequence of states a € gl""^ 1 such that OCq = qo and for 
1 < n < \w\, a n = 8(a n -\,A n ,w n ). 

We say a string w € is accepted by the automaton with advice M if the final state appearing the 
run ofM on w is in F. 

A language LCE* is regular with advice A if it is the language accepted by some automaton with 
advice A. A language L is regular with advice if there exists A such that L is regular with advice A. Thus 
L is not regular with advice means that there is no A such that L is regular with advice A. 

What is the power of this model of computation? We make some trivial observations: 
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1. Every regular language is regular with advice (indeed, any advice will do). 

2. Every unary language L (ie. subset of {1}*) is regular with advice (indeed, let A be the character- 
istic sequence of L). 

Is every language regular with advice? For a fixed advice A the answer is clearly 'no' : there are contin- 
uum many languages and only countably many languages regular with advice A (since there are countably 
many finite automata). 

This simple argument does not preclude the possibility that for every language L there is an advice Ai 
such that L is regular with advice A^. Also note that the standard pumping and Myhill-Nerode arguments 
showing non-regularity do not apply in the presence of advice. We now sketch an alternative argument 
that in fact the language {0"1" : n G N} is not regular with advice. 

Recall that for a language L, the equivalence relation =l on £*, called the Myhill-Nerode congruence, 
is defined as follows: x =l y if for all z € £* it holds that xz,£L yz G L. The classical Myhill-Nerode 
theorem states: 

Theorem 2 (Myhill-Nerode). A language LCI* is regular if and only if =l has finitely many equiva- 
lence classes. 

The proof of the Myhill-Nerode theorem for classical automata suggests the following observation 
regarding automata with advice: 

Let M be an automaton with advice which accepts the language L with some advice A. Suppose that 
M, starting in the initial state, reaches the same state on input x as on input y. If M is also at the same 
place in the advice tape A after reading x and y, that is, if x and y have the same length, then x =l y. Thus, 
for every n, the number of classes of =l restricted to TP (the strings in £* of length exactly n) is at most 
the number of states in M. 

For language L and integer n write =i n for the equivalence relation =l restricted to If there 
exists n such that the number of equivalence classes of =/,.„ is k, then no automaton with advice having 
fewer than k states accepts L. 

We now have a way to prove that certain languages are not regular with advice. Consider L := 
{0"1" : n G N} and note that for every n, no pair of strings in the set X n := {0 a l n ~ a : | < a < n} are 
=L. n -equivalent. But the size of X n is unbounded as n grows. Thus L is not regular with advice. 

The observation above gives one direction of a Myhill-Nerode like characterization. We prove the 
other direction in Section[2l The role of the size of the alphabet T is considered in Section[3] A variation 
of the model — which we call non-terminating — in which the automaton reads the rest of the advice is 
considered in Section [4] Finally, we mention in Section [5J that the results go through for tree automata 
with a fixed infinite tree as advice. 

Related work 

Automata over finite words can be identified with weak monadic second-order formulas over the structure 
(N,succ). Non-terminating automata with advice correspond to WMSO formulas over expansions of 
(N,succ) by unary predicates P (this is implicit in H |2l [U [2). Questions of logical decidability are 
equivalent to the P-acceptance problem: given a Muller automaton M, decide whether or not M accepts 
P. Similar things are done for automata operating on finite trees [5] [Definition 11] and O. 

It is easy to see that the languages recognized by non-terminating automata with advice are closed 
under logical operations such as union, complementation, projection, permutation of co-ordinates and 
instantiation (see for instance (51). Consequently, one may define automatic structures with advice (|f3l). 
These are relational structures whose domain and atomic relations are recognized by automata with 
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advice. The case without advice is well studied, and such structures have decidable first-orer theory 
(see 10). The main programme there has been to supply techniques for showing non-automaticity. For 
instance, there is a difficult proof of the fact that (Q, +) is not automatic without advice ( iPTOlD . However it 
is automatic with advice (communicated by Frank Stephan and Joe Miller, and reported in [7]). Because 
this example is not yet well known we present it here. 

Example 3. To simplify exposition, we give a presentation of ([0, 1) n Q, +). Each rational is coded by 
a finite string over the alphabet {0, 1 , #}. Automata for the domain and the addition will have access to 
the advice string 

A = 10#1 1#100#101#1 10#1 1 1#1000# • • • 

which is a version of the Champernowne-Smarandache string. To every rational q in [0,1) there is a 
unique finite sequence of integers a\---a n such that < a, < i, q = L" = 2 lf> an d n is minimal. The 
presentation codes this rational as /(«2)#/(tf3)#/(«4) ■ ■ -#f(a n ) where f sends a,- to the binary string of 
length [log 2 /] + 1 representing a,. Addition a + b is performed least significant digit first (right to left) 
based on the fact that 

aj + bi + c 1 a, + bi + c — i 
i\ ~ (z-1)! + i\ 

where c G {0, 1 } is the carry in. In other words, if at + bj + c >i then write a, + b/ + c — i in the ith segment 
and carry a 1 into the (i — \ )st segment; and if aj + bj + c < i then write this under the ith segment and 
carry a into the (i — l)st segment. These comparisons and additions can be performed since the advice 
tape is storing i in the same segment as a; and bj. 

We remark that the advice string A above has decidable acceptance problem (IH). Consequently 
every structure that is automatic with this advice has decidable first-order theory. 

We end with a question that we hope will spur interest: what are other interesting examples of 
structures that are automatic with advice? 
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2 The Myhill-Nerode Theorem 

Let £ be a finite alphabet and LCI* a language. Define an equivalence relation =l, u on If 1 , the set of 
all strings of length n, by x =L, n y if for all z G Z* it holds that xz G L yz G L. This is the usual 
Myhill-Nerode congruence restricted to strings of length n. 

Theorem 4 (Myhill-Nerode theorem with advice). A language LCI* is regular with advice if and only 
if there is some k G N such that for every n>0, =L,n has at most k equivalence classes. 

Proof. Suppose L is regular with advice. Let M = (Q,L,r,A,8,qo,F) be the automaton recognizing L, 
and let k = \Q\. Now assume that for some n, =£,„ divides the strings of length n into / equivalence 
classes, with I > k. Pick representative strings x\, . . . ,xi in these classes. Let qi G Q be the (n + l) st state 
in the run of M on xu that is, the state reached after reading the final character of X[. Since I > \Q\, qi = qj 
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for some i ^ j. Then for all z G £*, M accepts x,z if and only if M accepts XjZ, since the run of M on these 
two strings is the same after stage n. This contradicts the assumption that x, and Xj are representatives of 
distinct =L, n - classes. 

Conversely, suppose we have such a bound k. For each n G N, let c € n be the collection of equivalence 
classes of =L, n , so \W n \ <k. 

We must construct an automaton M recognizing L. Let Q = {1, . . . ,2fc} be the set of states, and 
let F = {1, . . . ,k} C Q. The idea is that we have enough room to represent each equivalence class by 
an accepting or a rejecting state as necessary at each stage. Set q = 1 if the empty string is in L and 
qo = k+\ otherwise. 

For x, y G if x =L, n v> then x G L if and only if y G L (appending the empty string as a suffix). Thus, 
% is partitioned into those classes which are "accepting" and those which are not. Also if x =l „ y, then 
for all a G L, xa =L, n +i ya, since for all z G £*, x«z G L if and only if yaz G L. This defines a function 
h n : x £ — > % t+ \ so that if C G ^ and x is a string in C, then xa is a string in the class h n (C,a). 

For each n > 0, identify the "accepting" classes with states from {I,... ,k} and the remaining classes 
with states from {k+ 1 , . . . , 2&}. The remaining work is to encode the transition information given by the 
functions h n into the advice tape. 

Enumerate all functions Q x Z — > 2 by (fi)f =1 , where N = (2A:) 2 *I E I , and let T = (ci)f =l be the advice 
alphabet. Each character codes a possible transition behavior. For each n G N, pick a function which 
respects h n in the sense that if a class C G ^„ is associated to the state j, then for any character a£l, 
fi(j,a) is the state associated to h n (C,a). Since not every state is associated to a class, may behave 
arbitrarily on some inputs. Set the 71 th character of the advice tape A to be c,. 

Finally, we define the transition function 8 : Q x T x Z — > 2 by 5(j',c,-,a) = fi(j,a). It is easy to 
check by induction on length that M accepts the string x if and only if x G L. □ 

3 On the role of alphabet size 

In our proof of the Myhill-Nerode theorem with advice, we made use of a large advice alphabet. This 
raises the question of whether the size of the advice alphabet is essential. 

Does there exist k such that if L is regular with advice, then already L is regular with some 
advice over an alphabet of size kl 

The answer is 'no'. For k G N let REGA^ be the set of languages that are regular in some advice with 
advice alphabet of size k. Then REGAi are the regular languages, and REGA^ C REGA^+i. We prove 
that REGA* ^ REGA^+i for all k G N. 

For A G {0, . . . ,k} m , let Pref(A) be the language consisting of all prefixes (initial segments) of A. The 
set Pref(A) is clearly regular with advice A, but if we choose A carefully, then Pref (A) is not regular with 
any advice £ G {0, . . . , k -\} w . 

To simplify the proof, we will change the question to one about deterministic transducers. A deter- 
ministic transducer is a machine M which reads an infinite input string B and produces an infinite output 
string A. We denote this by M[B] = A. At each stage, M produces an output character based on an input 
character and its current state. 

If we have an automaton M recognizing Pref (A) with advice B, we can transform it into a determin- 
istic transducer M* such that M* [B] = A. Note that on the run of M on the (infinite) input string A, M 
is always in an accepting state, and for each state and advice character pair (q,b) occuring in the run, 
there is exactly one input character a (the next character of A) such that S(q,b,a) is an accepting state. 
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Without changing the language accepted by M, we may adjust the transition function so that for each 
pair of an accepting state q G F and an advice character b (even those pairs not appearing in the run of 
M on A), there is exactly one input character a such that 8(q,b,a) is an accepting state. 

Now we define the deterministic transducer M* so that it reads the advice string and at each stage 
produces the unique acceptable input character as output. That is, M* has the same state set as M, and if 
M* reads the advice character b in state q, it produces the output character a as above and transitions to 
8(q,b,a). 

Proposition 5. There exists an infinite string A over alphabet £ = {0, . . . , k} such that for every deter- 
ministic transducer M (with input alphabet T = {0, ... ,k— 1} and output alphabet EJ and every infinite 
string B over T, M[B] ^ A. 

Proof. We diagonalize. For each deterministic transducer M with input alphabet T and output alphabet 
£, we will produce a finite string um from £ such that um does not appear as a substring of M[B] for any 
string B eT m . 

Let Q be the states of M. For q G Q and b G T, write M q [b] for the character in £ produced by M 
in state q upon reading the character b. Among the k\Q\ characters M q [b] (parametrized by b G T and 
q E Q), there must be a character, say a G £, that occurs at most times. Let a be the first character 

of um- Let Q' be those states q' G Q such that for some b G T and q G Q, M q [b] = a and M transitions 
to q'. Note that \Q'\ < \Q\ < \Q\, so Q' is a proper subset of <2. Replace Q by 2' and repeat to get 
the next character of um and a new set of states Q" C Q' . After a finite number of steps, we will have 
|<2 | = 0> at which point we have finished constructing u^. 

Now we claim that um cannot appear as a substring of M[B] for any B G r m . Suppose for contradiction 
that it does appear in the run of M on B. At the step in which M begins producing um, it is in some state 
q G Q. It reads a character from B, outputs the first character of and transitions into a state in Q' . 
After the next step, M transitions into a state in Q". After n steps, regardless of the content of B, M must 
be in a state in Qy 1 '. But Qy 1 ' is empty. 

Concatenating the countably many strings um, we obtain our string A. For every deterministic trans- 
ducer M and every infinite string B, M[B] ^A, witnessed by the presence of um as a substring of A. □ 

4 Nonterminating automata with advice 

In the introduction we defined an automaton with advice as one that terminates after reading its finite 
input string (Definition [T]). In this section, if L is regular with advice A we will say that L is terminating 
regular with advice A. There is another way to define automaton with advice, in what we call the non- 
terminating model. Here automata are defined with an infinitary acceptance condition. After the input 
string ends, the automaton continues to read the advice, producing an infinite run. The run is successful 
if it satifies the acceptance condition. We work with deterministic Muller automata, in which the input 
string is accepted if the set of states visited infinitely often is in the collection F of accepting sets of 
states. 

Definition 6. A nonterminating automaton with advice is a tuple M = ((?,£, T,A, 8,qo,F), with data 
just as before, except: 

• 8 : Q x r x (Z U {□}) — > Q is the transition function. Here blank (□) is a new symbol that is read 
once the input string has ended. 

• F C ^P(Q) is the acceptance condition, where &(Q) is the powerset of Q. 
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The run ofM on a string w € £* is an infinite sequence of states a € Q m such that OCq = qo and: 

• For 1 < n < \w\: a n = S(cc n -i,A n ,w„). 

• For n > \w\: 0C n = 8((X n -i,A n ,C\). 

We say a string is accepted by an automaton with advice M if the set of states that appear infinitely 

often in a is an element of the acceptance condition F. 

A language L is non-terminating regular with advice A if it is the language accepted by some non- 
terminating automaton with advice A. A language L is non-terminating regular with advice if there exists 
A such that L is non-terminating regular with advice A. 

The distinction between the terminating and nonterminating models was irrelevant for our discussion 
of Myhill-Nerode because these models are equivalent if we do not fix the advice: 
Proposition 7. For every language L, there exists advice A such that L is terminating regular with advice 
A if and only if there exists advice B such that L is non-terminating regular with advice B. 

Proof. Given a terminating regular language, it is clearly also nonterminating regular with the same 
advice: the automaton can simply ignore the remainder of the advice, looping forever on the final state. 

In the other direction, suppose M = (<2,Z,r,A, S,qo,F) is a non-terminating automaton accepting L. 
Let a be the run of M on input w. Whether or not a is successful depends on whether or not M starting 
in state GC\ W \ and at position n + 1 of the advice tape accepts the empty string. This information can be 
encoded in the advice if we expand the advice alphabet. Formally, let B be the infinite string whose n th 
letter is the pair (A„, /„), where A n is the n th letter of the original advice A and /„ C Q consists of all states 
q such that automaton (Q,L,r,A[n + l,oo),d,q,F) starting in state q and position n + 1 in the adivce A 
accepts the empty string. Then L is terminating regular with advice A. □ 

If Lt(A) is the class of languages terminating regular with advice A and Ln(A) is the class of lan- 
guages nonterminating-regular with advice A, then Lj(A) C L^(A). However, the models are not equiv- 
alent for certain advice strings: 

Proposition 8. There exists advice A such that Lj{A) ^ L^(A). 

Proof. Let A be an infinite string on the binary alphabet F = {0, 1} such that Pref(A) is not regular 
(without advice). Let L be the language on the unary alphabet Z = {0} consisting of those strings of 
length n such that the (n + l) st character of A is a 1. 

The language L is easily seen to be nonterminating regular with advice A. Indeed, let M be a machine 
which loops until it reads a blank. At that point, if the advice character is a 1, it transitions to an infinite 
loop at a state q with {g} € F. If not, it transitions to an infinite loop at a state q' with {q'} $ F. 

But L is not terminating regular with advice A. The intuition is that when the input string ends, the au- 
tomaton cannot guess the next advice character. Suppose for contradiction that M = (<2,Z,r,A, d,qo,F) 
is a machine in the terminating model recognizing L with advice A. Then we can construct a machine 
M' = (Q' ,F,8' ,q' ,F') recognizing Pref(A) (without advice). 

Let Q' = Q U {r}, where r is a single new state, F' = Q C Q' , and q' = qo- Now define 8' : Q 1 x T — > Q' 
as follows: 



If a state q was an accepting state of M, it expects the next character of A to be a 1 , and if q was a 
rejecting state of M, it expects the next character of A to be a 0. Then M' recognizes Pref(A), contradicting 




our assumption on the complexity of A. 



□ 
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5 Tree automata with advice 

The classical Myhill-Nerode theorem has a natural generalization to (leaf-to-root deterministic) tree au- 
tomata [6]. Our refinement can be easily adapted to this setting, giving a characterization of the sets of 
labeled trees which are regular with advice. 

Definition 9. A (finite binary) tree t C {0, 1}* is a finite set of binary strings, called positions, which is 
downwards closed, in the sense that ifwEt and v is an initial segment ofw, then v G t. A labeled tree is 
a pair (t,l), where t is a tree and I is a function t — > T,for some finite alphabet £ 

The root of a nonempty tree is the empty string A. The children of a position w G ? are the positions 
wO and wl. 

Given a tree t and a position w £t such that w has a child w' ^ t, we call the child w' a graft site. We 
also consider the empty string X to be a graft site of the empty tree E.lfu is a graft site oft, then for any 
other tree x we define a new tree t\ u x = tU {uw \ w G x}. 1ft and x are labeled from £ by l t and l x , then 
t\ u x is also labeled from £: l(w) = l t (w)for w £t and l{uw) = l x (w)for w G x. 

An advice tree is a labeling of the complete binary tree {0, 1}* by a finite advice alphabet T, that is, 
a function A : {0, 1}* — > T . 

A tree automaton operates on a labeled tree t by assigning to all positions not in the tree a prescribed 
initial state. It then works inductively toward the root of the tree, assigning a state to each position in the 
tree based on the two states assigned to the children of that position and the label at that position. The 
automaton accepts if an accepting state is assigned to the root. A tree automaton with advice additionally 
has access to the advice character A(u) when assigning a state to position u G t. 

Definition 10. A tree automaton with advice is a tuple M = (<2,£,r,A, 8,qo,F). 

1. Q is the finite set of states of the automaton. 

2. £ is a finite set of symbols called the input alphabet. 

3. r is a finite set of symbols called the advice alphabet. 

4. A : {0, 1}* -> T is the advice tree. 

5. 8 : Q x Q xT x £ — > Q is the transition function. 
6- qo £ Q is the initial state. 

7. F Cg is the acceptance condition. 

The run ofM on a labeled tree (t,l) is an assignment r : {0, 1}* — > Q of a state to each position in 
the complete binary tree such that ifw^t, r(w) = qo, and ifwGt, r(w) = 8(r(wO),r(w\),A(w),l(w)). 
Since t is finite, there is a unique such assignment. 

A labeled tree (t,l) is accepted by M if r(A) G F. A set of labeled trees T is tree regular with advice 
if it is the set accepted by some tree automaton with advice. 

Remark 11. We have just introduced a terminating model. Of course there is also a non-terminating 
model (in this case the automaton is non-deterministic, starts at the root, and a run is successful if every 
infinite path satisfies a Muller condition). Just as in string case the two models are equivalent if we don't 
fix the advice (cf. Proposition^) and not necessarily equivalent if we do fix the advice (cf. Proposition^. 

Let £ be a finite alphabet and T a set of trees labeled from £. Define an equivalence relation =j on 
the set of all trees labeled from £ by x =j y if for any labeled tree t and any graft site u of t, it holds that 

t\ u x G T <J=^> t\ u y G T. 
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Theorem 12 (Myhill-Nerode theorem for trees). ^ A set of labeled trees T is tree regular if and only if 
=T has finitely many equivalence classes. 

The definition must be modified in the presence of advice: Given a position v G {0, 1}*, define the 
equivalence relation =j. v on the set of all labeled trees by x =x lV y if for any labeled tree t such that v is 
a graft site of t, it holds that t\ v x G T <J=^ t\ v y G T. 

Theorem 13 (Myhill-Nerode theorem for trees with advice). A set of labeled trees T is tree regular with 
advice if and only if there is some k G N such that for all v G {0, 1}*, =Tv has at most k equivalence 
classes. 

The idea of the proof is the same as in the finite string case. If a set of labeled trees is regular 
with advice, the number of =j v -classes must be bounded by the number of states. Conversely, given a 
uniform bound k, we may construct an automaton by associating a state to each equivalence class and 
encoding the transition information into the advice tree. 

We include the proof for completeness. 

Proof. Suppose T is tree regular with advice. Let M = (Q,L,r,A, 8,qo,F) be the tree automaton recog- 
nizing T, and let k = \Q\. Now assume that for some position v, =r iV divides the set of labeled trees into 
n equivalence classes, with n> k. Pick representative labeled trees x j «... « 3Cyi i n. these classes. Let t be a 
labeled tree with graft site v, and let q\ G Q be the state associated to the position v (which is the root of 
xi) in the run of M on t\ v Xi. Note that this is independent of the choice of t. Since n > \Q\, qi = qj for 
some i ^ j. Then for any tree t with graft site v, M accepts t\ v Xj if and only if M accepts t\ v xj, since the 
states of M assigned to positions in the base tree t only depends on the states assigned to positions in the 
grafted tree based on which state is assigned to the string v. This contradicts the assumption that x, and 
Xj are representatives of distinct equivalence classes. 

Conversely, suppose we have such a bound k. For each position v, let be the collection of equiva- 
lence classes of =l. v , so \%,\ < k. Note that ^ consists of at most two classes. Since the empty tree £ is 
the only tree with graft site A, and e\xt = t, s = T ^ t means that s and t are both in T or both not in T. 

We must construct an automaton M recognizing T. Let Q = {1, .. . ,k} be the set of states, and let 
F = {1} C Q. Set <yo = 1 if the empty tree is in T and qo = 2 otherwise. For each position v, we 
will associate one state to each equivalence class in This can be done arbitrarily, except for two 
requirements: 

• The state (1 or 2) named qo must always be associated to the equivalence class containing the 
empty tree. 

• For ^x-i tri e state 1 must be associated to the class consisting of those trees in T . 

For each input character a G £, we may form the singleton labeled tree consisting of just the root 
position labeled by a: t a = ({A}, A — > a). Now t a has two graft sites, and 1. If s and t are labeled 
trees, we can form the tree ti s>a A = {t a \os)\\t- Now for any position v, if s =7>o s' and t =r, v i t', then 
? (s,a,f) =t.v t(s'.af)- Indeed, for any labeled tree x with graft site v, 

x\vt( s , a ,t) G T <^=> ((x\ v t a )\ vQ s)\ vl t G T 




((x\ v t a )\vos)\ v it' €T 
((x\ v t a )\vlt')\vOS G T 

(MvOlviOU/er 
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This defines a function h v : % Q x %i xE->? f so that if C € %,q, C € %,\ and s eC,t eC, then 
f (i,«,f) i s a member of the class h v (C,C ,a). We now wish to encode this transition information into the 
advice tree. 

Enumerate all functions Q x Q x L Q by (fi)f =1 , where N = kr™, and let T = (ci)f =1 be the 
advice alphabet. Each character codes a possible transition behavior. For each position v, pick a function 
fi which respects h v in the sense that if states j and / are associated to classes C G %,q and C G 
then for any character fi{j,j',a) is the state associated to h n (C,C ,a). Since not every state is 

associated to a class, /; may behave arbitrarily on some inputs. Set A(v) = c,-. 

Finally define the transition function 8 : Q x Q x T x £ — > Q by 8(j,j',Ci,a) = fi(j,j',a). It is easy 
to check that M accepts the labeled tree t if and only iftET. □ 
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